A Laboratory-Based Method for the Evaluation of Personalised Search
نویسندگان
چکیده
Comparative evaluation of Information Retrieval Systems (IRSs) using publically available test collections has become an established practice in Information Retrieval (IR). By means of the popular Cranfield evaluation paradigm IR test collections enable researchers to compare new methods to existing approaches. An important area of IR research where this strategy has not been applied to date is Personalised Information Retrieval (PIR), which has generally relied on user-based evaluations. This paper describes a method that enables the creation of publically available extended test collections to allow repeatable laboratory-based evaluation of personalised search.
منابع مشابه
Review of ranked-based and unranked-based metrics for determining the effectiveness of search engines
Purpose: Traditionally, there have many metrics for evaluating the search engine, nevertheless various researchers’ proposed new metrics in recent years. Aware of this new metrics is essential to conduct research on evaluation of the search engine field. So, the purpose of this study was to provide an analysis of important and new metrics for evaluating the search engines. Methodology: This is ...
متن کاملAN OPTIMIZED NEURO-FUZZY GROUP METHOD OF DATA HANDLING SYSTEM BASED ON GRAVITATIONAL SEARCH ALGORITHM FOR EVALUATION OF LATERAL GROUND DISPLACEMENTS
During an earthquake, significant damage can result due to instability of the soil in the area affected by internal seismic waves. A liquefaction-induced lateral ground displacement has been a very damaging type of ground failure during past strong earthquakes. In this study, neuro-fuzzy group method of data handling (NF-GMDH) is utilized for assessment of lateral displacement in both ground sl...
متن کاملEvaluation of Personalised Information Retrieval at CLEF 2017 (PIR-CLEF): Towards a Reproducible Evaluation Framework for PIR
The Personalised Information Retrieval (PIR-CLEF) Lab workshop at CLEF 2017 is designed to provide a forum for the exploration of methodologies for the repeatable evaluation of personalised information retrieval (PIR). The PIR-CLEF 2017 Lab provides a preliminary pilot edition of a Lab task dedicated to personalised search, while the workshop at the conference is intended to provide a forum for...
متن کاملارزیابی خودکار جویشگرهای ویدئویی حوزه وب فارسی بر اساس تجمیع آرا
Today, the growth of the internet and its high influence in individuals’ life have caused many users to solve their daily needs by search engines and hence, the search engines need to be modified and continuously improved. Therefore, evaluating search engines to determine their performance is of paramount importance. In Iran, as well as other countries, extensive researches are being performed ...
متن کاملInvestigating the effect of the educational program in prospective of the principles of the case based discussion method in the microbiology clerkship of laboratory science students
Introduction: Clerkship in field is one of the important educational programs in the field of laboratory sciences and providing opportunities for students to learn in clerkship, improved the quality of health services. The aim of this study was to design a structured microbiology clerkship program from the perspective of case based discussion method among laboratory science students. Methods: ...
متن کامل